United States Patent and Trademark Office 



A 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


09/996,356 


1 1/29/2001 


Gregory Pulier 


786515600011 


1929 



24325 7590 07/14/2005 

STEPHEN D. SCANLON 
JONES DAY 

901 LAKESIDE AVENUE 
CLEVELAND, OH 44114 



EXAMINER 



NGUYEN, MAIKHANH 



ART UNIT 



PAPER NUMBER 



2176 

DATE MAILED: 07/14/2005 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO-90C (Rev. 10/03) 



Office Action Summary 


Application No. 

09/996,356 


Applicant(s) 

PULIER ET AL 


Examiner 

Maikhanh Nguyen 


Art Unit 

2176 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
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A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 27 April 2005 . 
2a)l3 This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) I3 Claim(s) 7-23 is/are pending in the application. 
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5) D Claim(s) is/are allowed. 

6) I3 Claim(s) 1^23 is/are rejected. 
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Application Papers 
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DETAILED ACTION 

1. This action is responsive to the following communications: Amendment filed 04/27/2005 
to the original application filed 1 1/29/200 1 . 

2. Claims 1-23 are currently pending in this application. Claim 1 is independent claim 

Priority 

3. Examiner acknowledges the claims for domestic priority under 35 U.S. C. 1 19 (e) to 
provisional application 60/253921, which was filed 1 1/29/2000. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

r 

obviousness rejections set forth in this Office action: 

(a) Apatent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if 
the differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would 
have been obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the claims under 35 U.S.C. 103(a), the examiner 
presumes that the subject matter of the various claims was commonly owned at the time any inventions covered therein were made 
absent any evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out the inventor and invention 
dates of each claim that was not commonly owned at the time a later invention was made in order for the examiner to consider the 
applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 
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Claims 1-23 remain rejected under 35 U.S.C. 103(a) as being unpatentable over 
Purnaveja et al. (U.S. 6,230,172 - filed 09/1999) in view of Nakayama et al. (U.S. 
6,493,748 -filed 07/2000). 
As to independent claim 1: 

a. Purnaveja teaches a computer-implemented method for integrating video data 

with a document object that includes document elements (e.g., a video and audio 
stream, together with annotations such as textual and graphical information in an 
integrated seamless package; col. 2, lines 20-27 /Abstract), comprising the steps 
of: 

(i) synchronizing the video data with at least one of the document elements, 
so as to form at least one synchronization association, said 
synchronization association interrelating an activity of the video data with 
an activity of the document object (e.g., synchronizing the display of video 
streams with annotations ... displayable events, such textual/graphic data 
in the form of HTML pages; col.2, lines 37-42/ col.5, lines 38-49/ col.9, 
lines 46-54); 

(ii) generating a synchronization file that includes the synchronization 
association (e.g., Synchronization scripts include annotation streams for 
synchronizing the display of video streams with annotations; col.2, lines 
37-42); and . 

(iii) the activity involving the video data appears on a computer-human display 
as integrated with the document object through the use of the 
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synchronization association (e.g., the client computer(s) is able to 
synchronously display video frame and displayable event(s) in a video 
window and event window(s), respectively; col. 3, lines 9-12/col.5, lines 
39-49). 

b. Purnaveja does teach "synchronization file", but does not specifically teach 
"associating the synchronization file with the video data." 

c. Nakayama teaches associating the synchronization file with the video data 
(coll 3, lines 9-37). 

d. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Nakayama in the system of 
Purnaveja because it would have provided the capability for managing the 
synchronization file and the relevant URLs included in clips of the streaming 
content, whereby the correspondence between the reproduced content and its 
relevant information can be maintained. 

As to dependent claim 2: 

a. Purnaveja teaches the document object is a web page (e.g., HTML pages; 
Abstract), the activity involving the video data to appear on the computer-human 
display as integrated with the web page (col. 2, lines 20-27 /col. 5, lines 39-49), but 
does not specifically teach associating with the video clip. 

b. Note the discussion in the rejection of claim 1 above for associating with the 
video clip. 

As to dependent claim 3: 
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Purnaveja teaches the document object is a web page that contains a background, wherein 
the synchronization file associated with the video clip allows the activity involving the 
video data to appear on the computer-human display as integrated with the web page's 
background (col. 2, lines 20-27 /col. 5, lines 39-49). 
As to dependent claim 5: 

Purnaveja teaches the web page's background is a virtual web page background (col. 2, 
lines 20-27/col.5, lines 39-49). 
As to dependent claim 6: 

Purnaveja teaches the document object is a web page (e.g., HTML pages; Abstract), 
wherein the video data is integrated into a web page in such a way that extraneous 
background of the web page is substantially hidden from view while the video data is 
played on the computer-human display (col. 6, line 61 -col. 7, line 22). 
As to dependent claim 7: 

Purnaveja teaches the document object s a web page (e.g., HTML pages; Abstract), 
wherein the video data is integrated into a web page such a way that a media player 
running the video data is substantially hidden from view while the video data is played on 
the computer-human display (col. 2, lines 20-26). 
As to dependent claim 8: 

Purnaveja teaches the document object is a web page (e.g., HTML pages; Abstract), 
wherein the video data is integrated into a web page in such a way that a media player 
running the video data is completely hidden from view while the video data is played on 
the computer-human display (col. 2, lines 20-26). 
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As to dependent claim 9: 

Purnaveja teaches the document object is a web page (e.g., HTML pages; Abstract), 
wherein the synchronization association allows the activity involving the video to be 
activated based upon the activity associated with the document object (col. 3, lines 9- 
12/col.5, lines 39-49) 
As to dependent claim 10: 

Purnaveja teaches the activity associated with the web page is selection of a line of text 
appearing on the web page, wherein the synchronization association allows the activity 
involving the video to be activated based upon the selection of the line of text (col. 2, lines 
20-42 /col. 5, lines 39-49 /col.7, lines 35-39). 
As to dependent claim 11: 

Purnaveja teaches the document object is a web page (e.g., HTML pages; Abstract), 
wherein the synchronization association allows the activity involving the web page to be 
activated based upon the activity associated with the video data (col. 3, lines 9-12/col.5, 
lines 39-49). 

As to dependent claim 12: 

Purnaveja teaches the activity associated with the video data is the video data reaching a 
preselected time during playing of the video data (col. 7, lines 35-39 and Fig. 7), wherein 
the synchronization association allows the activity involving the web page to be activated 
based upon the activity associated with the video data (col.3, lines 9-12/col.5, lines 39- 
49). 

As to dependent claim 13: 
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Purnaveja teaches the activity involving the web page is a display of at least one line of 
text (col. 2, lines 20-42 /col. 5, lines 39-49 /col.7, lines 35-39). 
As to dependent claim 14: 

Purnaveja teaches synchronizing the video data with a second web page element so as to 
form a second synchronization association, said second synchronization association 
interrelating a second activity of the video data with a second activity of the web page 
(col. 2, lines 37-42/ col. 5, lines 38-49), wherein the synchronization file includes the 
second synchronization association/ col. 3, lines 9-12/col.5, lines 39-49), wherein the 
second association activity associated with the video data is the video data reaching a 
second preselected time during playing of the video data, wherein the second 
synchronization association allows the second activity involving the web page to be 
activated based upon the second activity associated with the video data (col.9, lines 46- 
54). 

As to dependent claim 15: 

Purnaveja teaches the second activity involving the web page is a display of a second line 
of text (col. 2, lines 20-42 /col. 5, lines 39-49 /col.7, lines 35-39). 
As to dependent claim 16: 

a. Purnaveja does not specifically teach "preprocessing the video data before the 
video is synchronized at said step (a)." 

b. Nakayama teaches the preprocessing of the video data before the video is 
synchronized (col.4, lines 11-18/ col.6, lines 31-34/col.l2, lines 2-6). 
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c. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Nakayama in the system of 
Purnaveja because it would have provided the capability for reproduces clips of 
the streaming content when a start time specified in the synchronization file has 
come. 

As to dependent claim 17: 

a. Purnaveja does not specifically teach "the preprocessing of the video data 
includes preprocessing the video data through a chromakey process to remove a 
colored screen background and replace it with the web page's background." 

b. Nakayama teaches the preprocessing of the video data (col. 4, lines 11-18/ col.6, 
lines 31-34/col.l2, lines 2-6) includes preprocessing the video data through a 
chromakey process to remove a colored screen background and replace it with the 
web page's background. 

c. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Nakayama in the system of 
Purnaveja because it would have provided the capability for reproduces clips of 
the streaming content when a start time specified in the synchronization file has 
come. 

As to dependent claim 18: 

a. Purnaveja does not specifically teach "the preprocessing of the video data 
includes the video data being cropped and resized." 
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b. Nakayama teaches the preprocessing of the video data includes the video data 
being cropped and resized (col. 4, lines 11-18/ col.6, lines 31-34/col.l2, lines 2-6). 

c. It would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to include the feature from Nakayama in the system of 
Purnaveja because it would have provided the capability for creating compressed 
data by diving the streaming content from the synchronization file. 

As to dependent claim 19: 

Purnaveja teaches the preprocessing of the video data includes compressing the video 
data, and using the compressed video data in the synchronizing of the video data with a 
document element during said step (a) (e.g., compressed video stream ... for 
synchronizing the display of video streams; Abstract /col. 2, lines 29-58 and Fig.4A). 
As to dependent claim 20: 

Purnaveja teaches the preprocessing of the video data includes using the video data in an 
uncompressed format so that quality adjustments to the video data may be performed 
(e.g., uncompressed video data; col.6, lines 1-7). 



5. 



Response to Arguments 

Applicant's arguments filed 04/27/2005 have been fully considered but they are not 
persuasive. 
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Applicant argues that Nakayama does not disclose a synchronization file that is used to 
interrelate activity of the video data with an activity of the document object. (Remarks, 
page 8, last para.) 

In response, Nakayama is not used to teach "a such file", Purnaveja teaches a 
synchronization file that is used to interrelate activity of the video data with an activity of 
the document object (Synchronization scripts include annotation streams for 
synchronizing the display of video streams with annotations, e.g., displayable events, 
such textual/graphical data in the form of HTML page; see the Abstract and col. 2, lines 
37-42). 

Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

McCue U.S Patent No. 6,076,104 Issued: Jun. 13, 2000 

YAGER etal. U.S. Publication 2003/001 1627 Al Pub. Date: Jan. 16, 2003 
Balkus et al. U.S. Publication 2004/0268224 Al Pub. Date: Dec. 30, 2004 

7. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is 
reminded of the extension of time policy as se.t forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
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extension fee pursuant to 37 CFR 1. 136(a) will be calculated from the mailing date of the 



advisory action. In no event, however, will the statutory period for reply expire later than 
SIX MONTHS from the mailing date of this final action. 
8. Any inquiry concerning this communication or earlier communications from the 

examiner should be directed to Maikhanh Nguyen whose telephone number is (571) 272- 
4093. The examiner can normally be reached on Monday - Friday from 9:00am - 5:30 
pm. 



examiner should be directed to Maikhanh Nguyen whose telephone number is (571) 272- 
4093. The examiner can normally be reached on' Monday - Friday from 9:00am- 5:30 
pm If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather Hemdon can be reached on (571) 272-4136. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 



9. 



Any inquiry concerning this communication or earlier communications from the 
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